Eye movement differences when recognising and learning moving and static faces.

Seeing a face in motion can help subsequent face recognition. Several explanations have been proposed for this "motion advantage," but other factors that might play a role have received less attention. For example, facial movement might enhance recognition by attracting attention to the internal facial features, thereby facilitating identification. However, there is no direct evidence that motion increases attention to regions of the face that facilitate identification (i.e., internal features) compared with static faces. We tested this hypothesis by recording participants' eye movements while they completed the famous face recognition (Experiment 1, N = 32), and face-learning (Experiment 2, N = 60, Experiment 3, N = 68) tasks, with presentation style manipulated (moving or static). Across all three experiments, a motion advantage was found, and participants directed a higher proportion of fixations to the internal features (i.e., eyes, nose, and mouth) of moving faces versus static. Conversely, the proportion of fixations to the internal non-feature area (i.e., cheeks, forehead, chin) and external area (Experiment 3) was significantly reduced for moving compared with static faces (all ps < .05). Results suggest that during both familiar and unfamiliar face recognition, facial motion is associated with increased attention to internal facial features, but only during familiar face recognition is the magnitude of the motion advantage significantly related functionally to the proportion of fixations directed to the internal features.

A multi-lab test of the facial feedback hypothesis by the Many Smiles Collaboration.

Following theories of emotional embodiment, the facial feedback hypothesis suggests that individuals' subjective experiences of emotion are influenced by their facial expressions. However, evidence for this hypothesis has been mixed. We thus formed a global adversarial collaboration and carried out a preregistered, multicentre study designed to specify and test the conditions that should most reliably produce facial feedback effects. Data from n = 3,878 participants spanning 19 countries indicated that a facial mimicry and voluntary facial action task could both amplify and initiate feelings of happiness. However, evidence of facial feedback effects was less conclusive when facial feedback was manipulated unobtrusively via a pen-in-mouth task.

A neural signature for combined action observation and motor imagery? An fNIRS study into prefrontal activation, automatic imitation, and self-other perceptions.

INTRODUCTION: Research indicates that both observed and imagined actions can be represented in the brain as two parallel sensorimotor representations. One proposal is that higher order cognitive processes would align these two hypothetical action simulations. METHODS: We investigated this hypothesis using an automatic imitation paradigm, with functional near-infrared spectroscopy recordings over the prefrontal cortex during different motor simulation states. On each trial, participants (n = 14) observed a picture of a rhythmical action (instructed action) followed by a distractor movie showing the same or different action. Participants then executed the instructed action. Distractor actions were manipulated to be fast or slow, and instructions were manipulated during distractor presentation: action observation (AO), combined action observation and motor imagery (AO+MI) and observe to imitate (intentional imitation). A pure motor imagery (MI) condition was also included. RESULTS: Kinematic analyses showed that although distractor speed effects were significant under all instructions (shorter mean cycle times in execution for fast compared to slow trials), this imitation bias was significantly stronger for combined AO+MI than both AO and MI, and stronger for intentional imitation than the other three automatic imitation conditions. In the left prefrontal cortex, cerebral oxygenation was significantly greater for combined AO+MI than all other instructions. Participants reported that their representation of the self overlapped with the observed model significantly more during AO+MI than AO. CONCLUSION: Left prefrontal activation may therefore be a neural signature of AO+MI, supporting attentional switching between concurrent representations of self (MI, top-down) and other (AO, bottom-up) to increase imitation and perceived closeness.

Recognizing Genuine From Posed Facial Expressions: Exploring the Role of Dynamic Information and Face Familiarity.

The accurate recognition of emotion is important for interpersonal interaction and when navigating our social world. However, not all facial displays reflect the emotional experience currently being felt by the expresser. Indeed, faces express both genuine and posed displays of emotion. In this article, we summarize the importance of motion for the recognition of face identity before critically outlining the role of dynamic information in determining facial expressions and distinguishing between genuine and posed expressions of emotion. We propose that both dynamic information and face familiarity may modulate our ability to determine whether an expression is genuine or not. Finally, we consider the shared role for dynamic information across different face recognition tasks and the wider impact of face familiarity on determining genuine from posed expressions during real-world interactions.

Placing joy, surprise and sadness in space: a cross-linguistic study.

The valence-space metaphor posits that emotion concepts map onto vertical space such that positive concepts are in upper locations and negative in lower locations. Whilst previous studies have demonstrated this pattern for positive and negative emotions e.g. 'joy' and 'sadness', the spatial location of neutral emotions, e.g. 'surprise', has not been investigated, and little is known about the effect of linguistic background. In this study, we first characterised the emotions joy, surprise and sadness via ratings of their concreteness, imageability, context availability and valence before examining the allocation of these emotions in vertical space. Participants from six linguistic groups completed either a rating task used to characterise the emotions or a word allocation task to implicitly assess where these emotions are positioned in vertical space. Our findings suggest that, across languages, gender, handedness, and ages, positive emotions are located in upper spatial locations and negative emotions in lower spatial locations. In addition, we found that the neutral emotional valence of surprise is reflected in this emotion being mapped mid-way between upper and lower locations onto the vertical plane. This novel finding indicates that the location of a concept on the vertical plane mimics the concept's degree of emotional valence.

Exploring the motion advantage: evaluating the contribution of familiarity and differences in facial motion.

Seeing a face move can improve familiar face recognition, face matching, and learning. More specifically, familiarity with a face may facilitate the learning of an individual's "dynamic facial signature". In the outlined research we examine the relationship between participant ratings of familiarity, the distinctiveness of motion, the amount of facial motion, and the recognition of familiar moving faces (Experiment 1) as well as the magnitude of the motion advantage (Experiment 2). Significant positive correlations were found between all factors. Findings suggest that faces rated as moving a lot and in a distinctive manner benefited the most from being seen in motion. Additionally findings indicate that facial motion information becomes a more important cue to recognition the more familiar a face is, suggesting that "dynamic facial signatures" continue to be learnt over time and integrated within the face representation. Results are discussed in relation to theoretical explanations of the moving face advantage.

Movement cues aid face recognition in developmental prosopagnosia.

OBJECTIVE: Seeing a face in motion can improve face recognition in the general population, and studies of face matching indicate that people with face recognition difficulties (developmental prosopagnosia; DP) may be able to use movement cues as a supplementary strategy to help them process faces. However, the use of facial movement cues in DP has not been examined in the context of familiar face recognition. This study examined whether people with DP were better at recognizing famous faces presented in motion, compared to static. METHODS: Nine participants with DP and 14 age-matched controls completed a famous face recognition task. Each face was presented twice across 2 blocks: once in motion and once as a still image. Discriminability (A) was calculated for each block. RESULTS: Participants with DP showed a significant movement advantage overall. This was driven by a movement advantage in the first block, but not in the second block. Participants with DP were significantly worse than controls at identifying faces from static images, but there was no difference between those with DP and controls for moving images. CONCLUSIONS: Seeing a familiar face in motion can improve face recognition in people with DP, at least in some circumstances. The mechanisms behind this effect are unclear, but these results suggest that some people with DP are able to learn and recognize patterns of facial motion, and movement can act as a useful cue when face recognition is impaired.

Independence of face identity and expression processing: exploring the role of motion.

According to the classic Bruce and Young (1986) model of face recognition, identity and emotional expression information from the face are processed in parallel and independently. Since this functional model was published, a growing body of research has challenged this viewpoint and instead support an interdependence view. In addition, neural models of face processing emphasize differences in terms of the processing of changeable and invariant aspects of faces. This article provides a critical appraisal of this literature and discusses the role of motion in both expression and identity recognition and the intertwined nature of identity, expression and motion processing. We conclude by discussing recent advancements in this area and research questions that still need to be addressed.

Fast lemons and sour boulders: Testing crossmodal correspondences using an internet-based testing methodology.

According to a popular family of hypotheses, crossmodal matches between distinct features hold because they correspond to the same polarity on several conceptual dimensions (such as active-passive, good-bad, etc.) that can be identified using the semantic differential technique. The main problem here resides in turning this hypothesis into testable empirical predictions. In the present study, we outline a series of plausible consequences of the hypothesis and test a variety of well-established and previously untested crossmodal correspondences by means of a novel internet-based testing methodology. The results highlight that the semantic hypothesis cannot easily explain differences in the prevalence of crossmodal associations built on the same semantic pattern (fast lemons, slow prunes, sour boulders, heavy red); furthermore, the semantic hypothesis only minimally predicts what happens when the semantic dimensions and polarities that are supposed to drive such crossmodal associations are made more salient (e.g., by adding emotional cues that ought to make the good/bad dimension more salient); finally, the semantic hypothesis does not explain why reliable matches are no longer observed once intramodal dimensions with congruent connotations are presented (e.g., visually presented shapes and colour do not appear to correspond).

Independent influences of verbalization and race on the configural and featural processing of faces: a behavioral and eye movement study.

Describing a face in words can either hinder or help subsequent face recognition. Here, the authors examined the relationship between the benefit from verbally describing a series of faces and the same-race advantage (SRA) whereby people are better at recognizing unfamiliar faces from their own race as compared with those from other races. Verbalization and the SRA influenced face recognition independently, as evident on both behavioral (Experiment 1) and eye movement measures (Experiment 2). The findings indicate that verbalization and the SRA each recruit different types of configural processing, with verbalization modulating face learning and the SRA modulating both face learning and recognition. Eye movement patterns demonstrated greater feature sampling for describing as compared with not describing faces and for other-race as compared with same-race faces. In both cases, sampling of the eyes, nose, and mouth played a major role in performance. The findings support a single process account whereby verbalization can influence perceptual processing in a flexible and yet fundamental way through shifting one's processing orientation.

The effect of motion at encoding and retrieval for same- and other-race face recognition.

In an experimental study, we assessed the role of motion when encoding and recognizing unfamiliar faces, using an old/new recognition memory paradigm. Our findings revealed a clear advantage for learning unfamiliar faces moving non-rigidly, compared with static faces. This advantage for motion was found with both same- and other-race faces. Furthermore, results indicate that it is more important that the face is learnt in motion than recognized from a moving clip. Interestingly, despite a reliable other-race effect being revealed, participants were able to utilize motion information exhibited by other-race faces in a manner akin to the motion advantage found for same-race faces. The implications of these findings are discussed in relation to the nature of the stored face representations, considering whether the facilitative role found here can be explained by factors other than motion per se.